20 
1_ 



PHYSICAL 
DATABASE 



-SQL— 




35 
1/ 

TARGET 
DATABASE/ 

DATA' 
WAREHOUSE 



FIG. 1 

(PRIOR ART) 



42 



SELECT 00 DATA IN AN 
OBJECT MODEL 
(BY A USER) 



AUTOMATICALLY EXTRACT 

THE SELECTED DATA 
DIRECTLY FROM THE OBJECT 
N MODEL USING AN OBJECT 
QUERY LANGUAGE 



COMPARE METADATA 
FROM EXTRACTED DATA TO 
43^ METADATA FROM STAGING 
DATABASE 



AUTOMATICALLY BUILD 
4 . TABLES FOR THE 

X EXTRACTED DATA 



AUTOMATICALLY INSERT 
THE EXTRACTED DATA INTO 
THE TABLE 



48^ 



AUTOMATICALY LOAD THE 
TABLES INTO ATARGET 
RELATIONAL DATABASE 



FIG. 2 



jL 



PHYSICAL 
DATABASE 



-SQL — 



24 
\ 



ECOMMERCE PLATFORM 



OBJECT MODEL 




O 



-OQL- 



54 

l_ 



EXTRACTION 



Z 



SQL — TRANSLATION 



1_ 



USER 
INTERFACE 



■SQL- 



LOADING 



EXPORT ENGINE 



FIG. 3 





USER SELECTS AN OBJECT 






VIA GUI 


"^-62 








USER SELECTS DATA FIELDS 






OF THE OBJECT VIA GUI 










GUI CONSTRUCTS OQL FROM 




SETUP 


SELECTED OBJ. AND FIELDS 


^66 



CLEAN LOGS AND TABLES 



RUN THE OQL AGAINST THE 
OBJECT MODEL 



ONE TIME OPERATION FOR EACH RUN 



NEXT 
TABLE 



COMPARE OLD TABLE TO NEW 
TABLE 



EXISTING 



DIFFERENT TABLE DEFINITION 

i 



OVERWRITE? 



SAME TABLE DEFINITION 



TABLE 
^■73 

YES . 



.FIGURE OUT COLUMN 
NAMES AND DATATYPES 
ACCORDING TO METADATA 

•DETERMINE THE NUMBER 
OF COLUMNS NEEDED TO 
BUILD/UPDATE THE 
STAGING DB 

I 



QUERY STAGING/TARGET DB 



INO EXISTING T ABLE 



NO NEXT 
ROW 

NOTIFY SYSTEM ADMINISTRATOR 
LOG MESSAGES, SEND ALERTS 



CREATE NEW TABLE 
X 



-75 



PREPARE QUERY STATEMENT 
TO INSERT DATA BY USING 
PARAMETER MARKERS 



X 



EXECUTE QUERY AND MOVE 
TO THE NEXT ROW IN TABLE 



WRITE STATISTICS AND 
MESSAGES TO THE LOG 



MOVE TO THE NEXT TABLE 



FIG. 4 




128a 



loginpartition pcsv-partition pcsv-runTask 
AMSExport 



106 

^ 

APPLICATION 
SERVER 



OBJECT 
MODEL 



102 



ECOMMERCE 
PLATFORM 



SCHEDULER 
AMSExport 



130 



100 



EXPORT 
ENGINE 



MANUAL 
START X132 



CLIENT 
CLIENTID 



126 



134 



Get the date details for this client 
Get the AQL for ail active tables 
call the AMSTest.exportftableName) 
Update DW DATE CTRL(if 



110- 



112- 



104 



108 

_^ 

SERVER 



STAGING 
DATABASE 



TARGET 
DATABASE 



Stage_DB |Edit Date: 10/30/2001 


Description: 


Target DB: |Rev:0 


CreatorSRAJAK 


Table Name 


Ninja 



StageDBPassowrd=W; 
StageDBUser="DW"; 



"jdbc:oracle:thin:@ninja:1521:desd"; 



Connectionlnfo.Table 



^122a 



(run frequency 



122 



ScheduleTaskJable 



1 .execute SELECT using tableNameAQL Query. 
2.getConnection(JDBC)fo Ninja 



[.Populate columns and INSERT 
INTOtableName. 
S.update DW ETL LOGS 



/CONTROL LOG 
I CLIENTID,RUN~ 
NUMBER.RUN 
V DATE 

DW_DATE_CTRL 




-124 



-136 



-110a 



/CONTROL LOG 
TABLENAME"; 
AQL, 
V RUNORNOT 

DW_AQLS 




/CONTROL LOG/ 
STATISTICS 
AND ERROR 

v REPORTING V 

DW_ETL_LOGS 



^120 



FIG. 5 



